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ABSTRACT 

Someone who wants to measure affect in a local 
setting must construct his own instrument since there are few if any 
such instruments available from outside sources. The Thurstone 
attitude test constitutes one alternative operational definition of 
affect which can be used to accomplish this measurement task. There 
is a large array of specific skills which constitute the ability to 
construct a valid Thurstone test, since these skills are not 
generally available, a training package has been prepared to train 
the average college graduate to be able to prepare a Thurstone 
attitude test. Some of these skills involve voluninous arithmetic 
calculations for which the package provides two alternatives. Our 
method uses special computation sheets on which the calculations can 
be done by hand. The other employs data processing techniques making 
the tasks much easier. Results of a limited tryout (N = 15) are 
reported. A copy of a Thurstone affective instrument is appended. 
(Author/CK) 
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Measurement of Attitude 



The attitudes of an individual are frequently observed and 
subjectively evaluated in order to indicate something about his present 
or future performance. Parents evaluate the attitudes of their children, 
employers, of their employees; officers, of their subordinates; and 
teachers, of their pupils. Many of those doing the evaluating rely on 
simple methods such as adjective checklists or scales, personal observa- 
tion and self-report. When resources are available and a more precise 
measurement is desired, the evaluator is able to make use of one of the 
more sophisticated methods which employ a paper-and-pencil instrument as 
the operational definition of attitude. 

Instructional sequences have been prepared by the author and are 
currently being tested which train an individual to perform the skills 
necessary to construct an attitude test according to one of these methods. 
The principal steps pertaining to the method selected are briefly 
described below. The instructional sequences train subjects in all of 
these competencies. However, before launching into a description* of the 
procedures a few words about validity must be emphasised. 

Each of the several operational definitions of attitude is baaed on 
some hypothetical notion of the nature of attitude and derives validity 
largely from a corresponding set of procedures. Nearly all sets of 
procedures, if followed, result in a paper-and-pencil instrument (attitude 
teat) which may be administered to a subject whose attitude is being 
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evaluated. A particular attitude test is valid only when the procedures 
specified for its preparation are followed. One would not want to esti- 
mate the materials for a new house in terms of meterit and then record the 
estimates on a bill of materials in yards without making the proper 
adjustments to account for the differences in the standards of measurement. 
Even so one would not want to alter the set of procedures of an operational 
definition of attitude without recognizing that something different is 
being measured by using the altered procedures. 

To summarize, alterations of specified procedures should not be made 
in any situation unless they are justified on some grounds and unless the 
resulting changes in measurement are taken into account. 

Method and Procedures 

Before writing a program of instruction to train people how to 
construct an attitude test, one must decide upon a suitable method for 
measuring attitude. The method proposed by Thuratone (4, 1929) was 
selected by the author mainly because of its wide degree of acceptance 
and use. Most publications dealing in general with attitude measurement 
at least mention this method (3, pp. 11, 12, 1969) and (1, 1971). This 
method is based on the notion that someone's attitude is "reflected by 
the opinions he endorses" (J, 1971). A number of statements of opinions 
about the particular psychological object are selected, assigned scale 
values and assembled in the form of a paper-and-pencil test. An example 
of such an instrument having people at school as the psychological object 
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in appended below. Thin instrument wnn made for oubjccto who nre about 
sixteen years of age. The instrument yields o measurement of attitude 
toward a particular psychological object in terms of a continuous score 
which ranges between 1.0 and 11.0 depending on whether the subject's 
attitude is unfavorable or favorable, respectively. 

The mechanics of preparing and administering the instrument are 
easily performed. But there are procedures dictated by the method and 
the task that must be followed carefully. First, it is especially true 
in measuring attitude that the act of measuring affects the measurement. 
All possible steps should be taken to avoid creating expectations in the 
subject which affect his responses. For example, if the subject expects 
a particular attitude to be rewarded or punished and if he understands 
the method of raeaourement , then he will respond so as to gain the reward 
or avoid the punishment. This situation invalidates the measurement 
unless the reward or punishment are always present. 

Another feature of the preparation and administration phase concerns 
the requirements placed on the subject for responding to the various items. 
The subject muot be required to indicate agreement or disagreement with 
each item. The instrument must be prepared so ns to provide places for 
these responses to be recorded. 

Items are selected for the instrument on the basis of S-values and 
Q-volueo. An S-vniue and a Q-value are computed for each prospective item. 
This phase of the construction constitutes the chief disadvantage of the 
Thurstone method since it can be extremely time consuming and subject to 
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error. However, these difficulties can be avoided if definite procedures 
ore developed and followed uniformly. One major advantage of the pro- 
grammed sequence mentioned in the opening paragraphs is that it incorporates 
such procedures. 

Two different methods have been developed to accomplish computation 
of the S-vnlues and Q-vnlues. The first utilises machine-scored answer 
forms and a computer program made for the IBM 360/50 Operating System. 

This method enables one person to accomplish all necessary computations 
in one day if he has access to the scoring equipment and computer system. 

In addition to the necessary computations of S-values and Q-values the 
computational program has been augmented with subprograms which perform 
various functions helpful in analysing and using the resulting data. One 
subprogram causes the S-values and Q-values to be printed in such a way 
that items can be chosen moat easily. Another computes a statistic 
which indicates the performance of each individual author of prospective 
items. And another computes a statistic which indicates the performance 
of each individual author of prospective items. And another computes 
a statistic which Indicates the performance of each Judge, whose function 
will be discussed below. 

The other computational method accomplishes only the necessary 
computation of S-values and Q-values by use of hand computation. Pre- 
printed computation sheets and associated data collection forms minimise 
errors end serve a record-keeping function. 

The raw data necessary for computing S-values and Q-valuea is obtained 
during a Judging session wherein a number of trained judges appraise the 



favoirnbilifcy of each prospective item toward the stipulated ottitudinal 
object. During thin cession each judge classifies each prospective item 
in some interval on the eleven-interval Thurstone scale. The judges must 
be trained to perceive the Thurt'tone scale correctly so that each can 
record his appraisal accurately. One segment of the sequence of instruc- 
tion trains the subject to judge prospective items and also trains him to 
train others to do the same. 

Results of the judging session and the quality of the final instrument 
can be improved if the prospective items are critiqued and edited before 
they are judged. A prospective item should (1) be a short sentence with 
the mein verb or verba in the present tense; (2) constitute a value 
judgement of the attitudinal object; and (3) be nonfactual and unambiguous. 
Edwards (2, 1957) gives a longer list of attributes which a prospective 
item should have. However, some of those he specifies overlap. A 
procpective item which posessea the three properties given above will 
almost always satisfjr all those stipulated by Edwards for a prospective 
item. The collection of prespective items can be improved by rewriting 
unsatisfactory ones before they are submitted to the judge*. 

Considerations regarding the population with which the final instru- 
ment will be used play a most important role in writing prospective items. 
The best method found to date to prepare prospective items is to select 
a sample from the same population to write the prospective items. These 
authors of prospective items can be either trained to generate statements 
which satisfy the three conditions given above or else they can be placed 
into a structured situation and required to write several short sentences. 
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These sentences will usually be satisfactory prospective items if the 
situation is properly structured. The latter of the two procedures is 
the better because it requires less time of the authors. However, the 
sentences must be critiqued and edited in order to realise the full 
benefits. 

Before the prospective items are written the population and 
attitudinal object must be identified. The identities of the population 
and attitudinal objects are immediately obvious if the Thurstone instru- 
ment is being prepared as part of a trial solution to a bona fide problem. 
Otherwise, they are arbitrary. However, the results of the final 
instrument con be improved by selecting an attitudinal object which can 
be defined uniformly in the mindo of the subjects. Nebulous objects 
yield meaningless results. Well defined components of a nebulous object 
should be identified and a separate instrument prepared for each one. 

Items from each separate instrument could be assembled into one final 
instrument to yield one which considers various dimensions of a nebulous 
attitudinal object. 

Criterion Test and Results 

The instructional sequences mentioned above have been assembled and 
administered to several groups of subjects during the process of develop- 
mental testing. For the last such group of 15 subjects a post-test was 
prepared to measure performance of most terminal behavior. A copy of 
the post-test appears below in the Appendix. Each subject completed the 
instructional sequence independently on his own time without supervision. 
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All of the subjects were assembled to administer the post-test under a 
time restriction of 120 minutes. The number of subjects satisfying 
criteria Is depicted In Figure 1. 

6 - 

5- f 1 

4- 

3- 1 

2 1 

1 - 



1 2 3 4 5 

Correct Responses 

Figure 1. Distribution of Post-test Scores 

The resultc depicted in Figure 1 indicate that few subjects performed 
at a truly acceptable level. However, 20 percent of the subjects satis- 
fied criteria on all of the five post- test Items. And the results by no 
means categorically descredlt the instructional sequence for several 
reasons. First, subjects executed the instructional sequence independently 
so that there was no opportunity for feedback to be given them except what 
has been built into the program. Second, each of the five items on the 
post-test requires a certain degree of transfer of learning. Each is a 
substantial task. Third, the criteria for assessing performance on each 
item were stringent. Performance on this same post-test would be materially 
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(80 percent with no errors) if the instruction had been accomplished in 
a workshop setting with more appropriate practice and immediate feedback 
built into the sequence. 

Data collected during the developmental stages indicate that it is 
possible to train relatively naive subjects to produce valid attitudinal 
instruments by training them to follow previously validated procedures. 
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Instructions : Please write your name in the space at the top of thia 

page. Read each of the statementa listed below and decide whether you 
agree or disagree with it. If you agree with the statement, put a check 
mark (v^) in the blank below "Agree." If you disagree, put a check mark 
in the space below "Disagree." Please do this for all of the statements. 
Agree Disagree 

1. Moot of the kids at school are good kids. (1) 

2. I like many of the students at school. (5) 

3. Anyone who goes to school is "dumb." (7) 

4. "Get out of here you stupid idiot . "—That's what 

the people say to you at school. (16) 

5. Some of the people at school I know are just 

awful. But moat of them are real good guys. (21) 

6. I like aa many people at school as I hate. (27) 

7. The people at school are all stuck up. (28) 

8. Some are ao ignorant but a lot of them are nice 

at school. (29) 

9. The people at school are fun to be with. (31) 

10. They're a good bunch of people at school. (32) 

11. I hate school, I hate kids, I hate everything. (36) 

12. People at school say things that I don't like. (47) 

13. They're really neat people at school. You can talk 

to them and they are friendly. (52) 

(Go to the next page.) 
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Agree Disagree 

14. Some of the people I know at school are nice, some 
are ignorant, some are cool, some are smart, and 
some are "dumb." (53) 

15. I think they are all flunkies at this school. (57) 

16. The people at school are too mean. (63) 

17. People at school are good looking. (64) 

18. These kids at school aren' t very nice. (69) 

19. The people at school are too immature. (73) 

20. People are great at school. (78) 

(End) 
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CONSTRUCTION OP A THURSTONE ATTITUDE TEST - POSTTEST 

(10 minutes) March, 1971 

1. Using the attached computation sheet, compute the S-value and 
Q- value for a statement having the following judges' responses. 



Judge Number 
1 
2 

3 

4 

5 

6 

7 

8 
9 

10 



Number of Interval 
Where Judge Classified 
the Statement 

3 

4 

4 

5 
5 

5 

6 
7 

10 

11 



(10 minutes) 

2. Show that you are able to construct a Thurstone attitude test once 
the items have been chosen by designing the layout for the first 
page. Use the back of this page for your work. Since you are not 
given the actual test items for this problem, you must simulate 
them in some way. Design the instrument to be used with twelve- 
year-old subjects. A naive proctor should be able to administer 
your instrument with your first page as it stands. 
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(5 minutes) 

3. Choose as many statements as possible for use as Items on a 
Thurstone attitude test, on the bais of the scale values and 
Q-values given below. Use the criteria presented in your training 
sequence. Indicate your choice by placing an asterisk (*) to the 
left of the statement number of the statement chosen. 

TABLE OF SCALE VALUES AND Q-VALUES 

Statement Scale Q-Value Statement Scale Q-Value Statement Scale Q-Value 
Number Value Number Value Number Value 



14 


1.18 


0.72 


67 


4.00 


1.25 


40 


8.63 


1.73 


29 


1.33 


1.03 


78 


4.00 


2.04 


41 


8.75 


1.44 


60 


1.75 


1.25 


75 


4.67 


3.04 


6 


8.80 


1.58 


50 


2.06 


1.03 


31 


4.88 


2.38 


30 


8.89 


0.93 


36 


2.11 


0.93 


21 


5.91 


0.68 


11 


8.92 


1.40 


59 


2.14 


1.31 


28 


6.05 


0.97 


9 


9.00 


3.00 


10 


2.19 


1.41 


1 


6.29 


1.20 


57 


9.00 


1.90 


74 


2.19 


1.41 


71 


6.29 


1.50 


58 


9.08 


1.40 


69 


2.20 


2.15 


62 


6.31 


1.11 


76 


9.08 


1.38 


8 


2.20 


1.51 


17 


6.31 


1.41 


53 


9.19 


1.20 


51 


2.25 


1.63 


33 


6.43 


1.69 


27 


9.20 


1.57 


77 


2.25 


2.19 


66 


6.58 


1.96 


52 


9.25 


2.51 


22 


2.29 


1.31 


38 


6.89 


1.06 


42 


9.25 


2.94 


35 


2.29 


1.31 


47 


7.11 


0.87 


2 


9.33 


2.69 


63 


2.33 


2.06 


48 


7.19 


1.09 


39 


9.38 


1.90 


65 


2.43 


1.42 


15 


7.80 


1.53 


26 


9.63 


2.13 


70 


2.63 


2.15 


44 


8.00 


2.67 


73 


9.71 


1.13 


13 


2.67 


2.13 


25 


8.00 


2.63 


43 


9.75 


0.94 


45 


2.67 


2.31 


61 


8.00 


2.63 


20 


9.85 


1.31 


37 


2.69 


1.22 


5 


8.20 


1.51 


24 


9.85 


1.14 


16 


2.71 


1.50 


64 


8.20 


1.63 


56 


9.92 


0.58 


72 


2.80 


1.53 


68 


8.20 


1.69 


46 


10.20 


1.50 


4 


3.00 


2.50 


18 


8.25 


2.56 


12 


10.42 


1.17 


3 


3.38 


1.88 


54 


8.29 


1.50 


32 


10.56 


1.95 


55 


3.71 


2.17 


23 


8.29 


1.20 


49 


10.75 


1.25 


34 


3.80 


1.65 


79 


8.60 


1.39 


7 


10.92 


0.58 


19 


3.92 


1.50 


80 


8.60 


1.50 









4 

15 

O 

ERIC 



f • 



(15 minutes) 

4. You have been given five 4x6 file cards numbered from one through 
five, respectively. Write your name on each card. 

On each card write exactly one statement suitable for use’ on a 
Thurstone attitude test using "mathematics" or "math" aa the verbal 
representation of the attitudinal object. Apply the following 
criteria or conditions in writing these statements. 

a. The statement need not be a simple aentence. 

b. "Mathematics or "math" need not be the subject of the 
sentence. 

c. In a few minutes you will be judging the statements 
written by the class. Scale values will be computed 
from the data ob* iined. Write your five statements so 
that they will have scale values as close as possible 
to the target scale values listed in the table below. 

Note that each of your five cards has a card number . The target 
scale values in the table be'ow correspond to the card numbers. 
When you write a statement wh*ch you hope will have one of the 
target scale values listed below, be sure you write it on the card 
whose card number corresponds with the target scale value. 
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CARD NUMBER TARGET SCAIE VALUE 

1 _ 

2 

3 

4 

5 



(60 minutes) 

5. judge each of the statements just generated by the class members. 

If you are unable to properly classify a statement, then respond by 
placing a mark in column number on the IBM Form 553 . Columns 
are numbered from left to right from one through leven. 
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